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IMAGE INPUT UNIT AND IMAGE INPUT METHOD 

BACKGROUND OF THE INVENTION 
The present invention relates to an image input unit and 
5 an image input method for inputting a color image to be printed 
out . 

Hitherto, in a printer, complementary color ink has been 
used to finally output image data representing the values of 
CMY (Cyan, Magenta, Yellow) or CMYK (Cyan, Magenta, Yellow, 

10 blacK) and in a monitor, image data representing the values 
of RGB (Red, Green, Blue) is finally output. Generally, in 
image processing using a computer, color matching is performed 
with the display colors of a monitor as the reference and 
therefore in an image input unit such as a digital still camera, 

15 image data is represented in the area of RGB color space with 
the RGB values taking 0 or more. For example, in not only a 
digital still camera using primary color CCD, but also a digital 
still camera using complementary color CCD, when CMYG (Cyan, 
Magenta, Yellow, Green) image data provided from an input image 

20 is converted into RGB image data, processing of adjusting the 
components of a conversion matrix or replacing negative values 
with 0 is performed and only RGB values of 0 or more are output . 

For example, in sRGB standard, color coordinates of RGB 
are determined and RGB color space wherein the RGB values are 

25 0 or more is defined. However, the sRGB color space is narrower 
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than the color space that can be recognized by the visual sense 
of a human being and thus only a color space in a narrower range 
than the visual sense of a human being can be represented in 
an image input unit for outputting an image represented in the 
5 sRGB color space. 

On the other hand, in a printer, a color space wherein 
the CMY or CMYK values are 0 or more can be represented by printing . 
A printer for outputting an image represented in the color space 
wherein the CMY or CMYK values are 0 or more can use pigments 

10 for color development on the outside of the sRGB color space 
as CMY ink, thereby representing a wider color space than the 
sRGB-defined color space by printing. Likewise, the printer 
can represent a wider color space by printing than a color monitor 
manufactured with sRGB display as the reference. 

15 For such a printer to print image data recorded in an 

image input unit such as a digital still camera for recording 
an image represented in a color space wherein RGB colors 
represented in sRGB are 0 or more, the image is represented 
only in a narrower range than the color representation area 

20 of the printer, and the characteristics of the printer are not 
used effectively; this is a problem. 

In recent years, image data format standards allowing 
negative values in the colors of SRGB64, RIMM-RGB, etc., have 
been developed. However, if an attempt is made to allow negative 

25 values and improve the image quality, the information amount 
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per pixel is increased three bits and thus the image data formats 
result in an increase in the data capacity. 

SUMMARY OF THE INVENTION 
5 The invention is embodied considering such problems and 

it is an object of the invention to provide an image input unit 
and an image input method for expanding color space of a print 
image without increasing the data capacity. 

It is another object of the invention to provide 
10 an image input unit and an image input method for expanding 
color space of a print image without impairing the compatibility 
with an image file format in a digital camera in a related art. 

In order to solve the aforesaid object, the invention 
is characterized by having the following arrangement. 
15 (1) An image input unit comprising: 

a data generator which generates RGB image data 
representing each value of RGB for each pixel as signed data 
type from an input image; and 

a data converter which converts the RGB image data into 
20 YCbCr image data representing each value of YCbCr for each pixel . 
(2) The image input unit according to (1), wherein the data 
generator generates CMY or CMYG image data representing each 
value of CMY or CMYG for each pixel as unsigned data type from 
the input image, and converts the CMY or CMYG image data into 
25 the RGB image data. 
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(3) The image input unit according to (2), wherein the data 
generator includes a signed arithmetic circuit for converting 
the CMY or CMYG image data into the RGB image data. 

(4) The image input unit according to (2), wherein the data 
generator generates CMY or CMYG image data representing each 
value of CMY or CMYG for each pixel as unsigned data type of 
10 bits or more from the input image. 

(5) The image input unit according to (1) , wherein 

the RGB image data representing each value of RGB for 
each pixel generated by the data generator is signed data type 
of nine bits or more, and 

the RGB image data into YCbCr image data representing 
each value of YCbCr for eachpixel convertedby the data converter 
is unsigned data type of eight bits. 

(6) The image input unit according to (1), wherein the data 
converter enlarges color saturation represented by CbCr. 

(7) An image input method comprising: 

a data generation step of generating RGB image data 
representing each value of RGB for each pixel as signed data 
type from an input image; and 

a data conversion step of converting the RGB image data 
into YCbCr image data representing each value of YCbCr for each 
pixel . 

(8) The image input method according to (7) , wherein at the 
data generation step, CMY or CMYG image data representing each 



value of CMY or CMYG for each pixel as unsigned data type is 
generated from the input image, and the CMY or CMYG image data 
is converted into the RGB image data. 

(9) The image input method according to (8) , wherein at the 
5 data generation step, CMY or CMYG image data representing each 

value of CMY or CMYG for each pixel as unsigned data type of 
10 bits or more is generated from the input image. 

(10) The image input method according to (7), wherein 

RGB image data representing each value of RGB for each 
10 pixel generated at the data generation step is signed data type 
of nine bits or more is generated, and 

YCbCr image data representing each value of YCbCr for 
each pixel converted from the RGB image data at the data 
conversion step is unsigned data type of eight bits. 
15 (11) The image input method according to (7) , wherein at the 
data conversion step, color saturation represented by CbCr is 
enlarged . 

BRIEF DESCRIPTION OF THE DRAWINGS 
20 FIG. 1 is a data flowchart to show the contents of data 

transferred between blocks shown in FIG. 2. 

FIG. 2 is a block diagram to show a digital still camera 
1 as one embodiment of an image input unit according to the 
invention . 

25 FIG. 3 is a schematic drawing to show an area sensor of 
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the digital still camera according to the embodiment of the 
invention . 

FIG . 4 is a schematic drawing to make a comparison between 
the area of RGB color space and that of color space that can 
5 be recognized by a human being. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
One embodiment of the invention will be discussed with 
reference with the accompanying drawings. 

10 FIG. 2 is a block diagram to show a digital still camera 

1 as one embodiment of an image input unit according to the 
invention. FIG. 1 is a data flowchart to show the contents 
of data transferred between the blocks shown in FIG. 2. An 
optical system 10, an area sensor 11, an AFE (Analog Front End) 

15 12, and an image processing section 13 corresponds to a data 
generator in Claims, and a color space conversion section 14 
corresponds to a data converter in Claims. 

The optical system 10 is constituted by an optical lens, 
an infrared cut filter, an optical low-pass filter, etc., for 

20 forming a subject image as an input image on the area sensor 
11 . 

The area sensor 11 is an optical sensor of CCD, a CMOS 
sensor, etc., comprising photoelectric conversion elements for 
converting light into an electric signal, and each photoelectric 
25 conversion element is provided with a complementary color filter 
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for allowing light of wavelength of any of C (Cyan) , M (Magenta) , 
Y (Yellow) , or G (Green) to pass through. The photoelectric 
conversion elements are placed like a matrix as shown in FIG. 
3. The description to follow assumes that the area sensor 
5 comprising the photoelectric conversion elements each provided 
with a complementary color filter of any of C, M, Y, or G is 
used, but complementary color filters of three colors of CMY 
may be used as the filters of the photoelectric conversion 
elements . The purpose of acquiring color information of G in 

10 addition to color information of CMY is to directly acquire 
color information of G recognized sensitively by the visual 
sense, thereby improving the image quality. The area sensor 
11 outputs an analog signal responsive to the light reception 
amount of light of wavelengthof any of CMYG in each photoelectric 

15 conversion element to the AFE 12. 

The AFE 12 is constituted by a program gain amplifier, 
a CDS circuit, an A/D converter, etc., for sampling the analog 
signal output from each photoelectric conversion element and 
generating a digital signal representing the value of any of 

20 CMYG in each photoelectric conversion element as 10 to 12-bit 
data type. The analog signal is quantized to a digital signal 
of data type having a length of 10 bits or more, whereby 
high-quality YCbCr image data can be generated in the color 
space conversion section 14. The digital signal of CMYG is 

25 input to the image processing section 13 directly or after it 
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is stored in buffer memory. 

The image processing section 13 is implemented as an ASIC 
or DSP (Digital Signal Processor) engine implementing a 
predetermined algorithm as a logical circuit. If the image 
5 processing section 13 is implemented as an ASIC, processing 
can be speeded up as compared with the case where processing 
is performed by execution of a program in a DSP engine. The 
image processing section 13 performs AE (Auto Exposure) , AWB 
(Auto White Balance) , image generation processing, conversion 

10 processing from CMYG color space to RGB color space, y correction 
processing, etc. The image generation processing mentioned 
here is mainly processing of generating CMYG image data having 
four values of CMYG for each pixel by performing interpolation 
processing, etc . , using a digital signal representing the value 

15 of any of CMYG in each photoelectric conversion element. The 
conversion processing from CMYG color space to RGB color space 
is performed by a 4 X 3 matrix arithmetic processing circuit 
of ASIC or a multiplication circuit and an addition-subtraction 
circuit of DSP, CPU 19, etc. To allow negative values as the 

20 values of RGB output as a result of the conversion processing, 
the matrix arithmetic processing circuit, the multiplication 
circuit, the addition-subtraction circuit, and the like used 
for the conversion processing are formed as signed arithmetic 
circuits. The RGB image data representing each value of RGB 

25 is represented as data type having a larger number of bits than 



the number of bits of CMYG image data by one bit corresponding 
to a sign bit. For example, if CMYG image data is data type 
of a length of 12 bits having a domain of each color ranging 
from 0 to 2 12 -1, RGB image data becomes signed data type of 
5 a length of 13 bits having a domain of each color ranging from 
-2 12 -1 to +2 12 -1. It is desirable that data type of a length 
of each color nine bits or more should be assigned to RGB image 
data for representing the data at least in the range of -64 
to 255. Further, if the domain is expanded to the range of 

10 -160 to 255, an image particularly good in color reproducibility 
can be provided. Taking the domain of R large in both positive 
and negative ranges leads particularly to improvement of the 
image quality. 

The color space conversion section 14 is constituted by 

15 a 3 X 3 matrix arithmetic processing circuit or a multiplication 
circuit and an addition-subtraction circuit of DSP, CPU 19, 
etc. The color space conversion section 14 performs linear 
conversion using a 3 X 3 matrix, thereby generating YCbCr image 
data representing the values of YCbCr from RGB image data. The 

20 matrix arithmetic processing circuit, the multiplication 
circuit, the addition-subtraction circuit, and the like used 
for the conversion processing are formed as signed arithmetic 
circuits . To compress and record image data in removable memory 
in a JPEG file format, the color space conversion section 14 

25 needs to output YCbCr image data rounded to eight bits. For 
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the color space conversion, using the following expressions 
conforming to ITU-R BT.601 

Y = 0.299R + 0.587G + 0.114B 

Cb = (-0.299R - 0.587G + 0.886B) X 0.564 + offset 
5 Cr = (0.701R - 0.587G -0.114B) X 0.713 + offset 

for example, the conversion expressions 

Y = 0.2990R + 0.5870G + 0.1140B 

Cb = -0.1687R - 0.3313G + 0.5000B + 128 
Cr = 0.5000R - 0.4187G -0.0813B + 128 

10 can be used. 

In the conversion processing using the expressions, 
arithmetic processing is performed internally with precision 
of nine bits or more with a sign and at the final output time, 
YCbCr is rounded to precision of eight bits and each value of 

15 YCbCr is output as unsigned data type of the length of eight 
bits having a domain ranging from 0 to 255. The purpose of 
rounding YCbCr to precision of eight bits at the final output 
time is to make the image data compatible with JPEG compression 
processing. In the process of the conversion processing, the 

20 values of CbCr may be increased in an equal ratio for enlarging 
the sizes of vectors represented by the values of CbCr, thereby 
increasing the brightness of an image. When color saturation 
is enlarged, the color saturation is made large in response 
to the color saturation before enlargement so as to enlarge 

25 the distribution area of the color saturation of each pixel. 

10 



For example, the color saturation before enlargement is 
multiplied by a constant, thereby making the color saturation 
large. Such processing results in diametrically enlarging a 
Munsell color solid that can be represented by the values of 
5 YCbCr. Such processing is fitted particularly for simulatedly 
compensating for brightness information lost in the process 
of performing arithmetic processing of the values of RGB. 

A compression processing section 15 may be implemented 
as an ASIC dedicated to compression processing or may be 

10 implemented as a DSP, CPU 19, etc. The compression processing 
section 15 performs compression processing conforming to the 
JPEG standard using DCT (Discrete Cosine Transform) and Huffman 
coding, and outputs a JPEG bit stream to a file section 16. 

The file section 16 records image data compressed in the 

15 JPEG file format in removable memory such as flash memory. The 
image file format need not be JPEG and if the image file format 
is an image file format consisting of information of YCbCr, 
the invention can be applied; for example, the image data may 
be recorded in the image file format of TIFF-YCbCr. 

20 A control section 17 includes : ROM 20 recording a control 

program, etc.; a CPU 19 for executing the control program, 
thereby controlling the optical system 10, the area sensor 11, 
the AFE 12, and ASIC or DSP implementing the image processing 
section 13, the color space conversion section 14, and the 

2 5 compress ion processing section 15; and RAM 18 for storing various 



11 



pieces of data as the control program is executed. The ROM 
20, the CPU 19, and the RAM 18 are connected each other by a 
bus . 

The embodiment is characterized by the fact that the area 
5 sensor 11 for outputting an analog signal responsive to the 
light reception amount of light of wavelength of any of CMYG 
for each photoelectric conversion element is used to generate 
CMYG image data and when the CMYG image data is converted into 
RGB image data, RGB image data having a domain also in negative 

10 values is generated without performing processing of putting 
the RGB image data into values of 0 or more, namely, without 
decreasing the information amount of the CMYG image data, FIG. 
4 schematically shows the color space of RGB taking values of 
0 or more and the color space that can be recognized by a human 

15 being. As shown in FIG . 4, the color space that can be recognized 
by a human being is wider than the color space of RGB taking 
values of 0 or more. Thus, if conversion is executed from the 
color space of CMY taking values of 0 or more to the color space 
of RGB taking values of .0 or more as in the related art, loss 

20 of color information that can be recognized by a human being 
occurs, resulting in color distortion before and after the 
conversion. In the above-described embodiment, negative 
values are allowed as input of the color space conversion section 
14, so that the color space that can be represented by an image 

25 consisting of color information of RGB is expanded and, for 
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example, when an image is printed out using complementary color 
ink, it is made possible to exhaustively represent the color 
information provided at the input time. 

Further, the embodiment is characteri zed by the fact that 
5 to record the image data in the file section 16 finally as a 
JPEG file, the YCbCr image data is represented as unsigned data 
type of eight bits and the information amount per pixel just 
before compression processing is performed is 24 bits for 
recording more color information without increasing the memory 
10 capacity. This uses the nature such that even if the RGB image 
data contains a negative value, if the RGB image data is converted 
into YCbCr image data according to the above-described 
conversion expressions, the YCbCr image data is put in a value 
of 0 or more. 

15 That is, according to the embodiment, negative values 

are allowed for RGB image data and image processing is performed 
with precision of nine bits or more for each color of RGB until 
justbefore conversion to YCbCr color space, and after conversion 
to YCbCr color space, the data is rounded to the precision of 

20 each color eight bits, whereby the image data can be recorded 
without increasing the data capacity. Therefore, on the output 
side, the values of RGB are output as data type having a domain 
to negative values at the inverse conversion time from the color 
space represented by YCbCr to the RGB color space, and conversion 

25 is executed from the RGB color space to the CMY color space 
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without losing the color information provided at the input time, 
so that color matching between the input image of the digital 
still camera 1 and the print image can be improved. 

In the description of the embodiment, an input image is 
5 provided through the area sensor 11 comprising complementary 
color filters. However, if the area sensor 11 uses primary 
color filters' of RGB, the image processing section 13 generates 
RGB image data provided with negative values by per forming matrix 
arithmetic processing from RGB image data having a value of 
10 0 or more in each color, whereby it is also possible to widen 

the area of the color space provided after y correct ion processing, 
for example. 

In the description of the embodiment, the digital still 
camera is illustrated as the image input unit, but the invention 
15 can also be applied to other image input units of a digital 
video camera, a scanner, a facsimile, etc. 
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